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ABSTRACT 

Universite de Montreal has implemented a program . 
review formula that is a standardized approach to relating program 
offerings, faculty resources, artd institutional budgetary reduction 
requirements. The methodology was^Jbased on normalization of the 
number of credits that a unit is Authorized to offer. For a typical 
degree program structure, the analytical scheme consisted of the 
following five steps: description of basic data, normalization of 
credit offerings, reduction of credits and full-time equivalents, 
verification of teaching resources vs. normalization, and 
recommendations, information is provided on teaching resources, 
degree programs and their structures, and productivity factors 
related to instructional data. Attention was also directed to how the 
parameters used in the reduction formula related to one another and 
to other variables describing departmental teaching activities and 
how the level of proposed reduction related to these indicators of 
activities and resources. A second analysis of the reduction pattern 
determined whether a substantial reorganization of teaching had been 
occurring among units and across disciplinary lines. (SW) 



********************************************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
a*************************'********************************************* 

V" . • , ' : , 

ER?C : ■". . ■•■ ; •'. 

- m — ' - - ' — - - - - ' mm — ,v^^..^^^r^ ^^^^^^^ 



CO 
CO 



THE AIR PROFESSIONAL FILE 



No. 14, Fajft-Winter 1982-83 



The Association for Institutional Research 



A METHODOLOGICAL APPROACH TO SELECTIVE CUTBACKS* 



ChalT% s H. Bfelanger, Director 
Lise Ttemblay, Research Officer 
* Ofiite of Institutional Research. 
■ Universite de Montreal 



"PERMISSION TO REPRODUCE THI8* 
MATERIAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES' 
INFORMATION CENTER (ERIC)." 



U3- DEPARTMENT OF EDUCATION 

NATIONAL INSTITUTE OF EDUCATION 

EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIC) 
■I 1 This document has been reproduced as 
received from the person or organization 
originating it, 
t^vTin 0 < chenges have boon made to improve 
reproduction quality. 

• PoiPts of view or opinions stated in this oW 
mont do not npcessahly represent official NIE 
position or policy. 




♦Adapted from a paper publislTjsd in tne Canadian Journal of Higher Education . 



. . . 2 ' 

o • ■ ■ ■ - 

jl! - - - • „ m -- - « ' - ■ — , mm — * k — 1 




The AIR Professional File no. Fan -winter 1982-83 

i The Association for Institutional Research 



A METHODOLOGICAL APPROACH TO SELECTIVE CUTBACKS* 



Charles H. Be* longer, Director 
Use Tremblay, Research Officer 
Office of Institutional ResearcH 
University de Montreal 



Budget cuts have become less and less a news, item as 
postsecondary institutions around the world have increas- 
ingly become targets of local and national governments 
trying to patch up faltering economies. In a survey of 
European universities conducted by the Organization (or 
Economic Cooperation and Development (OECD),, par- 
ticipating institutions were unanimous in deploring both 
the regression of consumable financial means and the 
budget decline, worsened by an overproportional increase 
in personnel costs (Bender and Henning, 1980). At the 
United Kingdoms forty-five universities, some adminis-* 
trators in the spring of 1981 were privately toying with the 
idea of asking faculty members to take voluntary pay cuts 
to avoid massive layoffs (Walker, 1981). The situation was 
not less severe in North American institutions. Many 
American legislatures had forced universities to operate 
with huge deficits and to declare a state of financial emer- 
gency (Magarrell, 1981; Watkins, 1981). Canadian provin- 
cial and federal governments als6 were being accused of 
having added colleges and universities to their "hit list" 
(Winter, 1981). 

In the Province of Quebec alone, the balance sheets 
of the six universities were expected to show a $60-miflion 
reduction in the total $816-million university grant by the 
end of May 1982 (Imbeajult, 1981). That austerity in 
higher education spending was only the beginning of a 
long-term plan to reduce expenditures in the' public sector. 
In 1981, the Quebec government unveiled a triennial plan 
for the financing of its universities, according to which the 
University de Montreal can anticipate a $45-millipn deficit 
between 1982 and 1985 (Carbonneau, 1981). That news 
^ame after the university had already imposed substantial 
lorizontal reductions for the fiscal ye£*r 1981-82, 

\ 

\ 

\ 

electing a Course of Action 

- Confronted with a critical situation, Universite' de 
\ Montreal officials took the position that the quality of 
academic programs and the vitality of the institution, to 
say nothing of its solvency, could no longer be safe- 
guarded by continuing to make across-ttje-board com- 
pressions of its $200-million operating budget in order to< 
erase a $l5-million annual average deficit during three 



•Adapted from * piper published in the Canadian Journal of Higher Education 
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consecutive years. These officials had to decide whether 
everybody would starve or someone would be thrown 
overboard. Two committees were established and mai^ 
dated to examine both the academic units and the admin- 
istrative units and to make recommendations to the Uni- 
versity Planning Committee (UPC) by October 1981. Both < 
committees completed their work on schedule and submit- 
ted their reports to the UPQfpr discussion and approval 
before presenting them through appropriate channels, As 
could be expected, many options— termination of aca- 
demic and nonacademic positions, deletion of services, 
voluntary pay cuts, early retirements with built-in incen- 
tives, protection of tenured positions on a part-time basis, 
and numerous others— were seriously considered in the 
course of deliberations of both task forces. 

The study of instructional units included detailed 
scrutiny of all degree programs (COPER, 1981). The gen- 
eral objective was to reduce teaching resources by use of 
the following means: (1) reducing .course offerings, (2) 
reducing section breakdowns, (3) eliminating courses with 
low enrolment, (4) promoting cyclical course offerings, 
(5) increasing section sizes, (6) raising discontinuance 
questions on low productivity programs, and (7) making 
more efficient use of teaching resources. 

There are no universal program evaluation formulae 
that could fit all institutions. The combination of teaching 
methods (lecture, laboratory, practicum), the mix of dis- 
ciplines, the degree program structures, internal capabili- 
ties, external needs and constraints, the historical context 
of each unit, and the institutional mission itself produce 
unique patterns. These factors and others have received 
extensive coverage in the literature, especially in the light 
of some rather dramatic institutional experiences (Shirley 
& Volkwein, 1978; Smith, 1980; Herman, 1982). In addi- 
tion, a number of authors have spelled out tfie difficulties 
and modi operandi involved in program discontinuance 
(Brewer, 1978; Davis & Dougherty, 1979; Dougherty, 
1981; Melchiori, 1981). 

Where program reviews are done in the context bor- 
dering financial exigency planning, institutions have a 
particulary difficult task in reconciling budgetary, pro- 
grammatic, and personnel considerations to produce rapid 
results (Moore, 1978). Despite these critical retrenchment 
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pressures, universities must find ways to reallocate resour- 
ces to growing fields such as computing ancj biotechnol- 
ogy (Mims, 1980) and to revitalize and retrain their 
instructional staff (Calhoun et al., 1980; Fleming, 1980). it 
was with that awareness; but not necessarily with full 
understanding of the obstacles that lay ahead, that the 
task force members went about the business of recom- 
mending reductions of course offerings and teaching 
personnel. 

Methodological and Analytical Scheme S 

Before becoming involved with the technicalities of 
the approach described in a recent article by Be*langer 
(1981), it is important to note (1) that most bachelors 
degrees (with the exception of a few professional ones) 
comprise widely heterogeneous proportions of compul- 
sory, optional, and elective courses amounting to 90 cred- 
its; and (2) that most professional programs in the health 
sciences area were evaluated on a basis substantially dif- 
ferent (student-teacher ratio) from that presented below. 

Essentially, the methodoJogy was based on normali- 
zation of the number of credits Ujai a unit was authorized 
to offer, taking the following factors into account: (1) its 
existing undergraduate degree program structures, (2) the 
average number of students in sections, (3) teajrfu^g 
resources, (4) other obiligations such\as service^ 
(5) disciplinary characteristics, and (6) pr 
uate programs. The analytical scheme Wks_intended to 
reduce, on a selective basis, the current level of resources. 
For a typical degree program structure, it consisted of the 
following five steps: ( 1) . description of basic data, (2) 
normalization of credit offerings, (3) reduction of credits 
and full-time equivalents (FTEs), (4) verification of teach- 
ing resources vs. normalization, and (5) recommendations. 



Table 1 

Presentation of Basic Data of a 
Typical Department 

Teaching Resources 



Table 2A 
Normalization of Credit Offerings 



FTE* career faculty members 
FTE part-time instructors 
Total FTE teaching staff 

Degree Program Structure ( Undergraduate) 

Compulsory Optional Elective 

Bachelors 21 60 <I5)" 9 

Major 33*** * 

. Minor V 24«« 3 

Instructional Data . 

Course credits taught (undergraduate) 
Section credits taught (undergraduate) 
Average section size (undergraduate) 
Course credits taught (graduate) 
Service course credits 

SCHs* (teaching)/ Total FTE teaching staff 
SCHs (tutoring)/ FTE career faculty members 



22.0 
5.7 
27.7 



Total Credits 

90 
60 
30 



225 
236 
37 
51 
21 
32 
6 



• FTE = full-time equivalent; SCH = student credit hour, 
* ••The number in ( ) indicates that a minimum of 15 optional credits 

out of a total of 60 must be taken outside the discipline. 
•••These are already included in the bachelor's credit offerings, 
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Number of Degree Multiplication Normalized 
Categories of Credits Progr ffi Credits Factor* Credits 



Compulsory 
Optional courses 
Service courses 
Protected credits" 



TOTAL 



i 



21 
45 
21 
35 



1.0 

2.3 ; 
l.o ] 
i.o^ 



21. 
35 



181 



•The factor is 1.0 except for optional credits. See Table 2b. 
•• Refer to introduction courses that have to, be broken down in sections. 



An application of that methodology for a selected 
department is presented in Tables 1 through 3b. Table 1 
gives a brief overview of actual teaching resources, degree 
programs and their structures, and various raw products 
and productivity factors related to instructional data. 
Table 2a uses the degree program credits of the various 
categories and multiplies them by a factor to arrive at a 
number of normalized credits. Multiplication factors 
(Table 2b) were determined from the observed number of 
students per section and kept constant for all units. The 
recommended reduction of credits and FTEs (Table 3a) 
is simply derived from a direct subtraction of actual 
course-credits taught from normalized course credits. The 
verification of teaching resources vs. normalization was a 
necessary step taken to check whether the department 
could meet the demands of the normalized number of 
course credits with its reduced teaching credit potential. 
With the example used in this presentation, one can 
observe (Table 3b) that the department could still 
maneuver with a margin of 22 credits, assuming it chose 
to offer the same number of graduate credits. Therefore, 



\ Table 2b 
Multiplication^ actor Used for Optional Courses 



N = Number of Students 
per Section 


Multiplication 
Factors 




N < 16 


1.5 




16 ^ N < 19 


1.6 




I9^N<22 


I. 5 ) 




22«£N<25 


1,8 




25 ^ N < 28 


1.9 




28 ^ N < 31 


2.0 




31 < N < 34 


2.1 




•34 ^ N < 37 


2.2 




37 < N < 40 


2.3 




40 ^ N < 43 


2.4 




43 ^ N < 46 


» 2.5 




46 ^ N < 39 


2.6 




, 49 «S N < 52 
52 ^ N < 55 
55 ^ N < 58 
58 ^ N 


2.7 
2.8 
2,9 
3.0 





* Table 3a . 




Reduction of Credits and FTEs 




Course credits taught (undergraduate) 




Course credits normalized (undergraduate) 


181 


Reduced number of credits 


44 


Reduced number of FTEs (44 -r 12*) 


3.7 



•12 credits = average teaching load per FTE 

Note: Graduate credits were not used in the above normali- 
zation formula since they were all protected as is. 



the final step of the process was to recommend (1) a 
reduction of 44 optional credits, (2) a reduction of 3.7 
JFT Es, (3) an increased student credit hour(SCH) produc- 
tivity, and (4) a sustained effort in research. 

The methodology which has just been described is a 
standardized approach designed to relate program offer- 
ings, faculty resources, and institutional budgetary reduc- 
tion requirements. The premises leading to its develop- 
ment were simple: It had to be developed quickly; it had 
to relate to the teaching and" programmatic activities of 
departments; and finally, it had to take into account the 
teaching resources* required to sustain a sufficient level of 
activities. The assumption that current program structures 
and course offerings were adequate, if not optimal, in 
attaining each department's educational goals was the 
basis for the rationalization of course offerings and faculty 
resources that would take place through the application of 
this methodology. 



Table 3b 

Verification of Teaching Resources vs. Normalization 



Teaching Resources before Normalization 

PTE career faculty me mbcrs 22.0 

Em i mated sabbatical leases* * 2.6 

Teaching Resources after Normalization 

Residual FTE career faculty members 19.4 
Residual total FTE: 

(I&.4 PTE CFM** ♦ 5.5 FTE PTI**)-3.7 FTEs 21.2 

Verification of Teaching Potential ' 
Teaching credit potential: 

21.2 FTEs X 12 (average teaching load) 254 
Normalized course credits: 

181 (undergraduate) ♦ 51 (graduate)*** 232 
Course credits taught (1980-«1): 

225 (undergraduate) > 51 (graduate)*** 276 
Section credits taught ( 1 980-8 1 ): 

236 (undergraduate) ♦ 51 (graduate)*** 287 



•One out of seven tenured faculty members is estimated to be on leave 
every year. 

•*CFM = career faculty member; PTI = part-time instructor. 
** 'Graduate credits were all protected. 



Although strong arguments can be put forth to defend 
the merits of this approach, the results must be analyzed 
in a more comprehensive planning perspective. To this 
end, we have performed two types of analysis. In the first, 
we examined how the parameters used in the reduction^ 
formula related to one another and to other variables de- 
scribing departmental teaching activities and how the level 
of proposed reduction related to these indicators of activi- 
ties and resources. In the Second, we analyzed the reduc- 
tion pattern to determine whether a substantial reorgani- 
zation of teaching resources had been taking place among 
units and across disciplinary lines and whether newer and 
smaller programs had been more affected by the reduc- 
tions than larger and longer established ones. 

Results of the Analysis 

The evaluation of the relative influence of the reduc- 
tion formula variables and of other related variables was 
undertaken through correlation analyses. Pearson product- 
moment correlation coefficients were used to measure the 
strength of the relationships between different variables 
describing the activities and resources of the JS^acqdemic 
departments. These variables included program structure 
(measured by the number of compulsory, optional, and 
elective courses contained in each department's under-' 
graduate programs), average section size, course credit „ 
offerings, faculty size and composition, and teaching pro- 
ductivity (measured by the ratio of student credit hours to 
teaching resources). Next, partial correlation coefficients 
provided a measure of association between pairs of varia- 
bles of the analysis while controlling the effect of one or 
more related variables. This second analysis was particu- 
larly useful in characterizing the relationships between the 
reduction levels calculated by the application of the for- 
mula and the variables of activity and resources described 
above. 

Results from the Pearson correlation analysis (Table 
4a) show that the reduction proposals were significantly 
but weakly linked to average section size (-.45), to under- 
graduate course credits taught (.32), and to teach produc- 
tivity (-,36). Furthermore, the relationships between the 
variable productivity and other variables of the analysis — 
such as section size, teaching resources, and course credit 
offerings— show that the overall level of activity and 
resources of departments was a determining factor Jn the 
proposed level of reduction. However, there were no sig- 
nificant relationships between reduction levels and faculty 
composition or between the structurcof course offerings 
and the proportion of optional courses relative to the total 
program structure of the department. 

The partial correlation analysis which was performed 
on different combinations of variables with the level of 
reduction as a dependent variable also showed the varia- 
ble productivity and its correlates to be significant con- 
trolling factors in the analysis (Table 4b). 

The correlation analyses have conclusively established 
that the greater the level of teaching activity and, indi- 
rectly, teaching resources a department had, the less reduc- 
tion fn activity and resources it had to assume. The use of 
a multiplication factor based on "section size" to, deter- 
mine the optional credit offerings for optional courses 
can, thus, be said to have indirectly introduced into the 
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Table 4a 
Correlation of Selected Variables 
of Teaching Activities and Resources 
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' 2 


3 


4 * 


5 


6 


7 . 
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1 

1 . 
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vjpuonai course > 
credit offerings 


1 000 

p= 


• U77 

.001 


.530 
.00\ 


.526 
.001 


.099 
.277 


.706 
.001 


.314 
.027 


-.048 
.386 
i 


I, 


Optional credit/ all 
credit offered (%) 


P=.00l 


1 .IA/V 


(177 
.32! 


.024 
.441 


-.111 
.253 


.107 
.260 


.047 
.388 


-.160 
.1.67 


1 

J. 


PTE -career faculty- 
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P=.00l 
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.321 
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.002 
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^211 
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time instructors) 


P=.00l 
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.00! 


1 .000 
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.711 
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.420 
.004 
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Table 4b 
Partial Correlation between Credit 
Reductions and Selected Variables* 












First-order partials 


Second-order partials 




Third-order partials 








Credit Reduction 
n with Average 
Class Size by 




Credit Reduction 
with Average 
Class Size by 




Credit Reduction 
with Average 
Class Size by 








VAR 1 
VAR 2 
VAR 3 




VAR ! and VAR 3 
VAR 2 and VAR 3 
VAR ! and VAR 2 


VAR 1 and VAR 2 and VAR 3 






-.281 P=.045 
-.470 P=002 
.529 P=.00l 




-.133 
-.437 
-.291 


P=219 
P=O04 
P=.042 




.001 


P=496 







•VAR I = SCHs/Total FTE teaching staff; VAR 2- Total PTE teaching staff; VAR 3 = Undergraduate credits taught 
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reduction procedure the criteria of performance and attrac- 
tion programs. Furthermore, the findings did not confirm 
the main criticism which some department heads had 
voiced against the methodolbgy— that the larger the pro- 
portion of optional course credits in a department's pro- 
gram structure, the smaller the reduction this department 
would have to support. 

The second analysis, aimed at evaluating the distribu- 
tional impact of the ^eduction methodology, used the 
Spearman rank-correlatiqn coefficient. The 38 depart- 
ments were rank ordered according to their levels of 
teaching resources before and after the reduction proce- 



dure was applied (Table 5). The results of the correlation 
analysis ( r s = .983, p < .01) show that the relative distri- 
bution of departments was not significantly affected by 
the application of the methodology and that a significant 
realignment of resources would not take place. An analy- 
sis of percentage point differences in FTE teaching re- 
sources showed reductions ranging from 0 to 30.6% from 
previous levels. The disciplinary areas most affected by 
redactions were languages and, to a lesser extent, some 
pure and applied sciences such as physics, chemistry, 
mathematics, and geology, The explanation may be that 
section size was related to laboratory activities embedded 
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Table 5 

Relative Ranking of Instructional Units and Percentage 
Change in FTE Resources from Past Levels v 



Instructional Unit 



Before the Reduction 
Rank FTE 



After the Reduction 
Rank FTE 



i Change 
in FTE 



Psychology 
Law 

Mathematics 

Physical education 

French studies 

Biology 

Theology 

Economics 

Translation 

History 

Art history 

Physics 

Educational psychology 

Chemistry 

Pharmacy 

Computer science 

Sociology 

Criminology 

Linguistics 

Rehabilitation ) 

Political science 

Industrial relations 

Geography 

English studies 

Philosophy 

German studies 

Social work 

Nutrition 

Hispanic studies 

Anthropology 

Communication science 

Speech & hearing therapy 

Geology 

Library science 

Russian studies 

Health administration 

Italian studies 

Demography 
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in the program structure of these departments and that 
this type of activity was overlooked by the methodology, 
with the result that resource reductions were unrelated to 
the requirements of these programs. A second explanation 
is also plausible: that the very low levels of student enrol- 
^rnent and, c^isequently, of teaching productivity that had 
been observed in these programs in recent years, especially 
in the areas of languages, physics, and geology, were 
responsible. These two factors (the mix of teaching activi- 
ties and low productivity) may have worked together to 
target these units for major reductions. 

The more traditionaLand longer established depart- 
ments such as sociology, philosophy, economics, psy- 
chology, and others rn the arts and humanities — have 
been assured of resource reductions of 5% or less from 
past levels because of their program structures', high levels 
of teaching productivity, and large average section sizes. 
Some of the newer programs, those in the field of lan- 
guage, for example, have been hit very hard. Others of the 
same si/e communication science, demography, and 
library science have fared well. Again, teaching produc- 
tivity seems to have been a determining factor in discrimi- 
nating-among older and newer programs. 

Conclusion 

In recent years, program review has been associated 
very closely with retrenchment and program discontinu- 
ance. The review process itself has become a long and 
cumbersome operation in which questions of authority, 
definition of institutional priorities, and search for con- 
sensus rarely have been resolved to the satisfaction of 
everyone involved. Other considerations often overlooked 
by the initiators of the review have been the time lags 
necessary to complete a wide range of studies and the 
human and financial costs that have been generated by 
comprehensive and multidimensional review operations. 

While there is a need for continued study of program 
review procedures in which quantitative and qualitative 
indicators can be assembled and appraised by appropriate 
bodies, most institutions have neither the time nor the' 
resources to perform univertfity-widc evaluations. Under 
these conditions, methodologies such as the one developed 
for the Univcrsite de Montreal can become valuable plan- 
ning tools by providing the first directions for program 
evaluation, for allocation of resources and, most impor- 
tantly, for reexamination of institutional priorities. 

1 he program review formula implemented at the 
University de Montreal has, in effect, proven to be useful 
in more than one respect. Despite its limited scope, the 
implemented formula has allowed for the introduction of 
criteria such as needs, institutional priorities, and general 
performance. For instance, when reductions in teaching 
resources were being considered, the nature of the teach- 
ing resources at stake was independently evaluated with 
respect to professional and tenure status, research produc- 
tivity, and> complementarity to other departmental re- 
sources this in addition to the verification in teaching 
capacity performed within the methodology itself. 

Another important result of this operation has been 
the insight that the methodology has provided on two 
long-standing issues of program evaluation: the appropri- 
ate size of optional course offerings and the match be- 
tween instructional activities and the teaching resources 
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required to sustain them. With respect to the first point, 
the methodology suggests linking optional course offer- 
ings to student attendance, group partitioning, and pro- 
ductivity. The criteria of need and efficiency are thus con- 
sidered for the definition of the appropriate threshold 
level. As for matching instructional activities to teaching 
resources, the calculated course offerings baseline can be 
used to indicate the most desirable level of resources 
which can be equated to the unit level of activity. 

A final and not less significant impact of the review 
process has been to create a situation whereby units are 
beginning to question their own modes of operation, their 
use of faculty resources, and their instructional activities. 
Efficiency, performance, and quality criteria are thus pro- 
gressively considered as important departmental priorities. 
There is hope that self-evaluation will lead to self-imposed 
reallocation of resources and to the necessary changes in 
departmental organization. 
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